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EXECUTIVE  SUMMARY 


Major  efforts  are  underway  within  the  Department  of  Defense  (DoD)  and  the  joint  services  to 
develop  and  transition  technology  which  will  speed  the  origination  and  exchange  of 
information  required  to  conduct  day  to  day  operations.  A  major  focus  of  these  efforts  are 
Interactive  Electronic  Technical  Manuals  (lETMs). 

lETMs  automate  the  diagnostics  and  maintenance  of  a  defense  system  and  may  use  an  expert 
system  to  perform  diagnostics.  Draft  BETM  specifications  are  being  reviewed  and  pilot 
studies  to  identify  portable  maintenance  aid  (PMA)  platforms  are  underway. 

The  purpose  of  this  task  is  the  development  of  a  prototype  lETM  based  on  the  (draft)  General 
Content,  Style,  Functionality  and  User  Interaction  (MIL-M-GCSFUI)  and  lETM  Data  Base 
(MIL-D-IETMDB)  Military  Specifications.  The  prototype  will  provide  a  framework  for 
evaluating  the  proposed  standards  and  whether  they  are  adequate  for  the  creation  of  a  viable 
lETM  using  commercial  off-the-shelf  (COTS)  software.  Unlike  prior  attempts  to  develop 
lETMs,  this  effort  utilizes  COTS  software  which  is  part  of  the  JCALS  system. 

The  prototype  integrates  a  hypertext  browser  and  a  model-based  expert  diagnostic  system. 

The  user  may  optionally  select  the  expert  system  to  perform  diagnostics  on  a  defense  system. 
The  prototype  system  will  be  interactive  and  context  sensitive.  The  data  used  for  developing 
the  lETM  data  base  and  demonstrating  the  prototype  system  are  from  the  Air  Force  Technical 
Orders  for  the  Communications  System  of  the  F-16  C  and  D  aircraft. 

This  report  details  design  considerations  for  the  preparation  of  the  technical  data  used  to 
develop  the  lETM  data  base,  the  tailoring  of  the  hypertext  browser  to  operate  according  to  the 
lETM  specifications,  and  the  integration  of  the  model-based  expert  system.  The  proposed 
user  interface  design  is  included  as  an  appendix  to  this  report 
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DISCLAIMER 


The  use  of  trade  names  in  diis  document  or  discussion  of  a  particular  product  does  nca 
constitute  an  endorsement  or  approval  of  the  use  of  such  commercial  equipment.  This 
document  may  not  be  cited  for  the  purpose  of  advertisement 
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SECTION  1 
INTRODUCTION 


1.1  BACKGROUND 

Major  efforts  arc  underway  within  the  Department  of  Defense  (DoD)  and  the  services  to 
develop  and  transition  technology  which  will  speed  the  origination  and  exchange  of 
information  required  to  conduct  day  to  day  operations.  Programs  such  as  Joint  Computer- 
aided  Acquisition  and  Logistic  Support  (JCALS)  arc  focusing  on  developing  the  capability  to 
exchange  technical  information  digitally  in  a  paperless  mode.  A  major  focus  for  future 
dissemination  of  digital  data  is  Interactive  Electronic  Technical  Manuals  (EETMs). 

lETMs  automate  the  diagnostics  and  maintenance  of  a  defense  system.  lETM  data  is 
optimally  arranged  and  formatted  for  interactive  screen  presentation  to  end-users.  lETMs 
may  or  may  not  use  an  expert  system  to  perform  diagnostics  on  a  defense  system.  Numerous 
efforts  related  to  lETMs  arc  ongoing.  Draft  lETM  specifications  are  being  reviewed;  pilot 
studies  are  underway  to  define  and  identify  portable  maintenance  aid  (PMA)  platforms. 

Products  automating  the  conversion  of  Standard  Generalized  Markup  Language  (SGML)- 
tagged  technical  information  to  easily  navigated  hypermedia  applications  are  available.  An 
expert  system-based  fault  isolation  and  diagnostic  tool  linked  to  such  an  application  would 
allow  the  JCALS  system  to  achieve  a  wide  range  of  lETM  capabilities  and  provide  empirical 
data  for  evaluating  and  improving  the  lETM  specifications. 

1.2  PURPOSE 

The  purpose  of  this  task  is  development  of  a  prototype  lETM  based  upon  the  (draft)  General 
Content,  Style,  Format  and  User-Interaction  (MIL-M-GCSFUI)  and  lETM  Data  Base  (MIL- 
M-IETMDB)  Military  Specifications.  The  prototype  will  provide  a  framework  for  evaluating 
the  proposed  standards  and  show  whether  they  are  adequate  for  creation  of  a  viable  BETM 
using  commercial  off-the-shelf  (COTS)  software. 

1.3  SCOPE 

The  prototype  consists  of  an  interactive,  context  sensitive,  electronic  display  system  used  to 
browse  a  hypertext  of  technical  information  and  perform  fault  isolation  and  repair  procedures. 
Fault  diagnosis  is  performed  either  via  predefined  fault  isolation  procedures,  or  through  the 
use  of  an  expert  diagnostic  system. 

Unlike  prior  attempts  to  develop  lETMs,  this  effort  utilized  COTS  tools  which  are  part  of  the 
JCALS  system  and  an  BETM  data  base  comprised  of  information  tagged  according  to  the 
Content  Data  Model  (CDM).  This  prototype  also  incorporates  a  model-based  expert 
diagnostic  system  which  operates  as  an  integrated  component  of  the  overall  lETM. 
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The  functionality  incorporated  into  the  prototype  is  based  upon  a  subset  of  the  features 
supported  by  the  CDM  and  the  GCSFUI.  A  number  of  factors  influenced  the  choice  of 
functions  and  are  detailed  in  Section  3  of  this  report 
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SECTION  2 

SELECTION  OF  TECHNICAL  DATA  AND  TOOLS  FOR  THE 

PROTOTYPE  BETM 


2.1  INTRODUCTION 

This  chapter  identifies  the  criteria  used  to  select  the  technical  manuals  (TMs)  and  tools  used 
to  develop  a  prototype  lETM  system.  The  TMs  selected  were  Air  Force  Technical  Orders 
(TOs)  which  provided  diagnostic,  maintenance,  and  other  supporting  technical  data  required 
for  development  of  the  BETM  data  base.  The  tools  used  for  this  task  were  all  COTS 
products,  including  one  which  is  part  of  the  JCALS  system  design. 

2.2  SELECTION  OF  TECHNICAL  DATA 

The  CDM  of  MIL-D-IETMDB  contains  a  content  specific  layer  Document  Type  Definition 
(DTD)  for  organizational  level  Air  Force  TOs.  Therefore,  to  obviate  the  need  for  developing 
a  different  content  specific  DTD,  it  was  determined  that  Air  Force  organizational  level 
manuals  should  be  used  in  creating  the  BETM  data  base  for  this  prototype.  Another  important 
factor  was  to  chose  a  defense  system  with  a  complete  set  of  TOs  written  to  the  latest 
applicable  Air  Force  technical  manual  specifications.  The  final  consideration  was 
accessibility  to  the  defense  system  library.  With  these  criteria  in  mind,  the  F-16  Aircraft  was 
chosen  as  tiie  candidate  defense  system. 

After  discussions  with  subject  matter  experts  (SMEs)  at  the  F-16  library,  it  was  determined 
that  documentation  for  the  F-16C  and  D  is  the  most  recent,  complete  set  of  TOs  available. 

The  SMEs  were  informed  that  this  data  would  be  used  to  create  an  BETM  data  base. 

The  F-16  Communications  system  was  chosen  for  the  prototype  effort  With  the  aid  of  the 
SMEs,  it  was  determined  that  the  fault  isolation,  fault  reporting,  general  systems,  illustrated 
parts  breakdown  manuals,  and  various  job  guides  contain  the  data  required  to  develop  an 
BETM  data  base. 

After  a  more  detailed  analysis,  the  VHF  subsystem  was  ultimately  selected.  The  VHF 
subsystem  data  provide  all  the  information  necessary  to  model  the  lETM  prototype.  A  list  of 
the  manuals  and  job  guides  used  in  the  course  of  this  task  are  contained  in  Section  5. 

2.3  SELECTION  CRITERIA  FOR  APPLICATION  TOOLS 

The  process  of  developing  this  lETM  prototype  entails  tagging  selected  portions  of  the  chosen 
TOs,  implementing  an  lETM  browser  (including  the  graphical  user  interface  [GUI]  and 
requisite  hypertext),  and  defining  a  model  for  use  by  an  expert  system  to  aid  in  fault  isolation. 
The  following  Sections  describe  the  tools  used  to  tag  the  data  (Section  3.1),  develop  the 
lETM  browser  (Section  3.2)  and  define  a  dynamic  fault  isolation  model  for  use  by  an  expert 
system  (Section  3.3). 
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2.3.1  SGML  Parser  and  Authoring  System 

Exoterica  Corporation's  XGML  CheckMark  application  is  being  used  to  markup  the  technical 
data  and  validate  the  tagged  instances  against  die  CDM.  Although  CheckMark  is  not  part  of 
the  JCALS  system,  it  is  being  used  because  of  its  availability  at  the  CALS  Technology  Center 
at  Ft.  Monmouth,  New  Jersey.  Moreover,  the  SGML  tools  which  are  part  of  the  JCALS 
system  (ArborText,  Inc.’s  ADEPT  Series  of  tools)  offer  a  higher  level  of  functionality  than 
required  for  this  task.  Nonetheless,  the  latter  could  have  been  substituted. 

2.3.2  lETM  Display  System 

Electronic  Book  Technologies'  (EBT)  DynaText  application  software  will  be  used  to  create 
the  lETM  prototype.  It  has  been  selected  as  the  lETM  browser  for  the  JCALS  system  by  the 
JCALS  contractor.  There  are  numerous  commercially  available  software  applications  which 
support  development  of  an  interactive,  hypertext  browser.  DynaText  was  selected  because 
one  of  the  goals  of  this  task  is  to  assess  the  feasibility  of  using  JCALS  system  COTS 
software  to  develop  an  lETM.  There  are  three  aspects  of  DynaText  which  were  considered 
important  to  this  task. 

•  DynaText  operates  on  SGML-tagged  documents. 

•  The  application  runs  in  the  DOS/Microsoft  Windows  environment,  as  well  as 
under  DECAJLTRDC. 

•  DynaText  has  a  development  tool  kit  which  will  be  used  to  customize  the 
application  to  interpret  the  CDM  DTD  tag  set. 

2.3J  Expert  System  Diagnostic  Tool 

The  expert  system  component  of  the  prototype  will  be  developed  using  the  I-CAT*’” 
(Intelligent  Computer-Aided  Troubleshooting)  software  produced  by  Titan  Software.  Ilie 
salient  feature  of  I-CAT  is  its  use  of  a  model-based  approach  to  fault  isolation  and  diagnosis. 
This  is  in  contrast  to  the  rule-based  method  embodied  in  the  logic  trees  in  the  paper-based 
fault  isolation  technical  manuals.  Equally  important  is  the  technical  expertise  which  Titan 
Software  provides  to  aid  in  translating  the  rule-based  approach  to  a  model-based  analysis. 
Finally,  I-CAT  runs  under  DOS/Microsoft  Windows  and  it  is  capable  of  being  integrated  with 
DynaText  in  that  environment 
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SECTIONS 

DESIGN  OF  THE  PROTOTYPE  lETM 


3.1  OVERVIEW 

The  lETM  prototype  will  be  comprised  of  customized  versions  of  the  DynaText  Browser  and 
the  I-CAT  expert  system  running  in  a  Microsoft  Windows  3.1  environment  Functionally, 
DynaText  and  I-CAT  will  operate  as  peers  in  terms  of  the  exchange  of  messages.  Data  is 
passed  between  the  two  applications  using  Microsoft  Windows'  Dynamic  Data  Exchange 
protocol.  The  interchange  between  DynaText  and  I-CAT  follow  below  (note:  "browser” 
refers  to  DynaText  and  "expert  system”  refers  to  I-CAT). 

•  The  browser  passes  control  to  the  expert  system  when  the  user  selects  dynamic 
fault  isolation. 

•  When  the  user  selects  a  test  point  or  a  module,  the  expert  system  notifies  the 
browser  with  a  message  which  indicates  the  type  of  information  (descriptive, 
graphics,  procedural,  or  parts)  and  a  string  which  uniquely  identifies  the  item 
requested.  In  response  to  the  message,  the  browser  displays  the  data  or 
initiates  a  test  or  repair  procedure. 

•  If  a  procedure  or  test  has  been  requested,  the  expert  system  suspends  execution 
awaiting  a  message  from  the  browser  indicating  the  procedure  or  test’s 
outcome. 

In  terms  of  window  management,  DynaText  will  define  and  manage  the  screen  layout  and  I- 
CAT  will  run  in  a  window  within  that  layout  With  the  exception  of  pointer  device  actions  in 
the  I-CAT  window,  all  user  input  will  be  mediated  by  DynaText  and  passed  to  I-CAT  as 
necessary. 

The  following  Sections  detail  the  implementation  requirements  for  the  DynaText  and  I-CAT 
applications. 

3.2  IMPLEMENTING  AN  EXPERT  SYSTEM-BASED  DIAGNOSTIC  TOOL 

I-CAT  supports  dynamic  fault  isolation  by  using  the  outcome  of  trouble-shooting  procedures 
to  select  successive  tests  as  it  attempts  to  isolate  a  faulty  component.  Underlying  this  process 
is  a  model  of  the  components  of  the  system  undergoing  maintenance.  The  model  embodies 
the  hierarchical  relationships  among  components  of  the  system  and  the  dependencies  among 
them.  The  major  effort  in  implementing  I-CAT  for  the  prototype  is  in  developing  a  model  of 
the  Communications  system  and  its  component  subsystems. 

Ideally,  the  system  model  would  be  developed  with  the  aid  of  F-16  Aircraft  subject  matter 
experts  (SMEs).  In  the  absence  of  such  experts,  the  model  will  be  developed  by  extrapolating 
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the  information  contained  in  the  technical  manuals  which  describe  the  Communications 
system  and  its  subsystems  (UHF,  VHP,  Secure  Voice  and  Interphone). 

It  will  also  be  necessary  to  develop  several  functions,  using  I-CATs  development  language  (a 
LISP  interpreter),  to  facilitate  DDE  exchange  of  messages  with  DynaText 

3.3  IMPLEMENTING  THE  DISPLAY  SYSTEM 

The  basic  DynaText  system  supports  creation  of  an  "electroruc  book”  browser  which  uses 
SGML-tagged  files  as  input  and  creates  a  hypertext  using  an  EBT  proprietary  scheme. 

To  develop  the  prototype  lETM,  the  basic  DynaText  browser  will  be  enhanced  to  interpret 
CDM-tagged  documents.  Of  particular  importance  is  the  creation  of  a  hyperdocument 
containing  text  and  graphics  data  which  are  based  upon  the  hyperlink  mechanism  as  defined 
in  the  CDM. 

An  important  characteristic  of  the  prototype  is  the  dynamic  display  of  information  as  a 
function  of  user  interaction  with  the  lETM.  Information  selected  for  display  depends  upon 
input  items  such  as:  identity  of  the  aircraft,  outcome  of  a  test,  skill  level,  or  selection  of  a 
hyperlink.  In  general,  DynaText  will  be  a  state-driven  system  where  its  functioning  and 
selection  of  information  will  depend  upon  the  current  system  state. 

The  figures  located  in  Appendix  A  illustrate  the  anticipated  user  interface  for  the  prototype 
lETM. 


3.4  PREPARATION  OF  THE  TECHNICAL  DATA 

Technical  information  used  in  the  lETM  prototype  includes  both  ASCII  text  and  graphics. 
Textual  data  are  scanned  in  and  processed  by  an  Optical  Character  Recognition  (OCR) 
application  to  generate  ASCII  text  files.  Graphics  data  are  scanned  in  and  processed  by 
several  image  processing  applications  to  generate  a  final  CALS-compIiant  raster  image.  The 
following  Sections  describe  the  steps  required  to  prepare  text  and  graphics  from  the  Air  Force 
TOs  for  use  by  the  lETM  prototype. 

3.4.1  Text  Data 

The  transfer  of  text  data  from  paper  form  to  a  computer-based  format  entails  two  stages  of 
translation.  First,  the  paper  document  is  digitized  to  produce  a  raster  image;  next,  the  raster 
image  is  processed  by  a  OCR  application  to  produce  ASCII  text  data. 

This  translation  process  is  not  without  its  share  of  problems.  If  the  paper  document  is 
scanned  in  at  too  low  a  resolution,  much  of  the  image’s  detail  may  be  lost,  and,  consequently, 
much  of  the  text  may  be  translated  inaccurately.  However,  if  the  document  is  scanned  in  at 
too  high  a  resolution,  the  time  taken  to  digitize  a  single  page  may  be  dramatically  increased, 
the  images  may  be  too  large  for  the  OCR  package  to  handle,  and  the  translation  time  for  each 
digitized  image  is  expanded. 
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Once  the  ASCII  text  data  are  produced,  it  must  be  examined  by  the  developers  to  verify  the 
accuracy  of  the  data.  This  essentially  involves  proof-reading  the  ASCII  text  data  and/or 
running  a  spell-checker  against  the  text  file. 

3.4.2  Graphics  Data 

All  of  the  graphics  used  in  the  prototype  are  black  and  white  line  drawings.  The  graphics  are 
scaimed  in  at  300  dots-per-inch  (dpi)  and  stored  in  uncompressed  Tagged  Lnage  File  Format 
(TIFF).  This  specific  scanning  resolution  was  selected  to  maximize  the  details  of  the  scanned 
image.  The  graphics  are  cleaned  and  cropped  to  remove  tmnecessary  information  and  then  re¬ 
sized.  The  dimensions  of  the  graphic  must  be  chosen  so  as  to  retain  the  detail  of  useful 
information  and  support  the  requirements  of  the  user  interface.  The  graphic  file  is  processed 
by  a  TIFF  compression  utility  to  produce  a  CCITT  Group  4  raster  image.  The  compressed 
file  is  then  processed  by  a  second  TIFF  utility  to  yield  a  CALS-compliant  header  for  the  file. 

Another  consideration  to  be  addressed  with  graphics  data  is  the  identification  of  "hotspots." 
Each  graphic  may  have  multiple  hotspots  defined  for  it  The  hotspots  will  provide  a 
mechanism  to  reference  related  information.  The  hotspot  will  be  defined  by  X  and  Y 
coordinates  for  the  upper-left  and  lower-right  hand  comers  of  a  rectangular  region  on  the 
graphic. 

3.4.3  Tagged  Document 

The  documents  to  be  tagged  for  the  lETM  prototype  are  listed  in  Section  5.  Each  document 
provides  information  for  the  diagnostics  and  maintenance  of  the  VHF  subsystem  of  the 
Communication  System  for  the  F-16  Aircraft.  Since  the  scope  of  the  lETM  prototype  is 
limited  to  the  VHF  subsystem,  only  the  information  relevant  to  that  subsystem  has  been 
targeted  for  inclusion  in  the  prototype.  A  brief  description  of  each  technical  manual  follows. 

•  The  General  Systems  manual  "gives  organizational  level  data  for  support  of  the 
communications  system  of  the  F-16"  to  include  "system  description,  system 
theory,  and  other  data  in  support  of  the  F-16  communications  system.*** 

•  The  Fault  Reporting  manual  is  "a  debriefing  aid  which  provides  the  flight  crew 
and  ground  personnel  with  the  detailed  technical  data  needed  to  expedite  the 
identification,  analysis,  and  reporting  of  fault  reportable  aircraft  system 
malfunctions  to  maintenance."* 

•  The  Fault  Isolation  manual  provides  "fault  identification,  description,  and 
isolation  procedures  for  the  [F-16]  communications  system."* 


‘T.O.  1F-16CG-2-23GS-00-1 
*r.O.  1F-16CG-2-00FR-00-1 
^.O.  lF-16CG-2-23n-00-l 
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The  Illustrated  Parts  Breakdown  manual  provides  a  detailed  maintenance  parts 
list  for  the  communications  systems  of  the  F-16C/D  aircraft 

The  Job  Guide  manual  "provides  stait-to-finish,  step-by-step  maintenance 
actions  for  the  F-16  VHF  communications  system  components."* 


*r.O.  1F-16CG-2-23JG-30-1 
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